2026-10-26 12:20:16,818 [ 229873 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-10-26 12:20:16,819 [ 229873 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-10-26 12:20:16,819 [ 229873 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-10-26 12:20:16,819 [ 229873 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_ervycs --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=2 --color=no --durations=0 test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users test_encrypted_disk_replication/test.py::test_replication test_encrypted_disk_replication/test.py::test_zero_copy_replication test_endpoint_macro_substitution/test.py::test_different_types test_endpoint_macro_substitution/test.py::test_select_by_type -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False collecting ... collected 5 items test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users FAILED [ 20%] test_encrypted_disk_replication/test.py::test_replication ERROR [ 40%] test_encrypted_disk_replication/test.py::test_zero_copy_replication ERROR [ 60%] test_endpoint_macro_substitution/test.py::test_different_types ERROR [ 80%] test_endpoint_macro_substitution/test.py::test_select_by_type ERROR [100%] ==================================== ERRORS ==================================== ______________________ ERROR at setup of test_replication ______________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_encrypted_disk_replication/test.py:36: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling zoo3 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling zoo3 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:20:48 [ 449 ] INFO : Running tests in /ClickHouse/tests/integration/test_encrypted_disk_replication/test.py (cluster.py:2659, start) 2026-10-26 12:20:48 [ 449 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:20:49 [ 449 ] DEBUG : Docker networks for project roottestencrypteddiskreplication are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:49 [ 449 ] DEBUG : Docker containers for project roottestencrypteddiskreplication are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:49 [ 449 ] DEBUG : Docker volumes for project roottestencrypteddiskreplication are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:49 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:20:49 [ 449 ] DEBUG : Docker networks for project roottestencrypteddiskreplication are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:49 [ 449 ] DEBUG : Docker containers for project roottestencrypteddiskreplication are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:49 [ 449 ] DEBUG : Docker volumes for project roottestencrypteddiskreplication are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:49 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestencrypteddiskreplication_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:20:49 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:20:49 [ 449 ] DEBUG : No running containers for project: roottestencrypteddiskreplication (cluster.py:829, cleanup) 2026-10-26 12:20:49 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:20:49 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:20:49 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:20:49 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:20:49 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:20:49 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:20:49 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:49 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:20:49 [ 449 ] DEBUG : Setup directory for instance: node1 (cluster.py:2679, start) 2026-10-26 12:20:49 [ 449 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_encrypted_disk_replication/configs/cluster.xml', '/ClickHouse/tests/integration/test_encrypted_disk_replication/configs/disk_s3_encrypted.xml', '/ClickHouse/tests/integration/test_encrypted_disk_replication/configs/disk_s3_encrypted_node1.xml'] to /ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/database (cluster.py:4488, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/logs (cluster.py:4499, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Setup directory for instance: node2 (cluster.py:2679, start) 2026-10-26 12:20:49 [ 449 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_encrypted_disk_replication/configs/cluster.xml', '/ClickHouse/tests/integration/test_encrypted_disk_replication/configs/disk_s3_encrypted.xml', '/ClickHouse/tests/integration/test_encrypted_disk_replication/configs/disk_s3_encrypted_node2.xml'] to /ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/database (cluster.py:4488, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/logs (cluster.py:4499, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:20:49 [ 449 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2993bc2bf171', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env (cluster.py:86, _create_env_file) 2026-10-26 12:20:49 [ 449 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:20:49 [ 449 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:20:49 [ 449 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:20:49 [ 449 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:20:49 [ 449 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:20:49 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:21:53 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:21:53 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:21:53 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:22:46 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:22:46 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling zoo3 ... Pulling zoo2 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:22:49 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:23:53 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:23:53 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling zoo1 ... Pulling resolver ... Pulling zoo2 ... Pulling minio1 ... Pulling zoo3 ... Pulling node2 ... Pulling node1 ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:23:59 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:25:04 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:25:04 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo3 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... done Pulling zoo2 ... done Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo3 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:25:13 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:26:06 [ 449 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling zoo3 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:26:06 [ 449 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:26:06 [ 449 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:26:06 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : Docker networks for project roottestencrypteddiskreplication are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:26:06 [ 449 ] DEBUG : Docker containers for project roottestencrypteddiskreplication are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:26:06 [ 449 ] DEBUG : Docker volumes for project roottestencrypteddiskreplication are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:26:06 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestencrypteddiskreplication_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : No running containers for project: roottestencrypteddiskreplication (cluster.py:829, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:26:06 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:26:06 [ 449 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:26:06 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:26:06 [ 449 ] DEBUG : Docker networks for project roottestencrypteddiskreplication are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:26:06 [ 449 ] DEBUG : Docker containers for project roottestencrypteddiskreplication are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:26:06 [ 449 ] DEBUG : Docker volumes for project roottestencrypteddiskreplication are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:26:06 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestencrypteddiskreplication_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : No running containers for project: roottestencrypteddiskreplication (cluster.py:829, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _________________ ERROR at setup of test_zero_copy_replication _________________ @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_encrypted_disk_replication/test.py:36: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling zoo3 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling node2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo3 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____________________ ERROR at setup of test_different_types ____________________ @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/storage.xml", "configs/macros.xml"], with_minio=True, with_hdfs=True, ) > cluster.start() test_endpoint_macro_substitution/test.py:27: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling hdfs1 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling hdfs1 ... pulling from prasanthj/docker-had... E Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... E Pulling hdfs1 ... status: image is up to date for p... E Pulling hdfs1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling hdfs1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling hdfs1 ... pulling from prasanthj/docker-had... Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... Pulling hdfs1 ... status: image is up to date for p... Pulling hdfs1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV HOSTNAME cee41938280b (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV PYTEST_ADDOPTS -rfEps --run-id=2 --color=no --durations=0 test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users test_encrypted_disk_replication/test.py::test_replication test_encrypted_disk_replication/test.py::test_zero_copy_replication test_endpoint_macro_substitution/test.py::test_different_types test_endpoint_macro_substitution/test.py::test_select_by_type -vvv (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 2 (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : ENV PYTEST_CURRENT_TEST test_endpoint_macro_substitution/test.py::test_different_types (setup) (cluster.py:400, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:26:07 [ 449 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:26:07 [ 449 ] DEBUG : HDFS BASE CMD:{self.base_hdfs_cmd)} (cluster.py:1209, setup_hdfs_cmd) 2026-10-26 12:26:07 [ 449 ] DEBUG : Cluster name: project_name:roottestendpointmacrosubstitution. Added instance name:node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:26:07 [ 449 ] INFO : Running tests in /ClickHouse/tests/integration/test_endpoint_macro_substitution/test.py (cluster.py:2659, start) 2026-10-26 12:26:07 [ 449 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:26:07 [ 449 ] DEBUG : Docker networks for project roottestendpointmacrosubstitution are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:26:07 [ 449 ] DEBUG : Docker containers for project roottestendpointmacrosubstitution are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:26:07 [ 449 ] DEBUG : Docker volumes for project roottestendpointmacrosubstitution are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:26:07 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Docker networks for project roottestendpointmacrosubstitution are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:26:07 [ 449 ] DEBUG : Docker containers for project roottestendpointmacrosubstitution are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:26:07 [ 449 ] DEBUG : Docker volumes for project roottestendpointmacrosubstitution are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:26:07 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestendpointmacrosubstitution_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : No running containers for project: roottestendpointmacrosubstitution (cluster.py:829, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:26:07 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:26:07 [ 449 ] DEBUG : Setup directory for instance: node (cluster.py:2679, start) 2026-10-26 12:26:07 [ 449 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_endpoint_macro_substitution/configs/storage.xml', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/configs/macros.xml'] to /ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/database (cluster.py:4488, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/logs (cluster.py:4499, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:26:07 [ 449 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'HDFS_HOST': 'hdfs1', 'HDFS_NAME_PORT': '50070', 'HDFS_DATA_PORT': '50075', 'HDFS_LOGS': '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/hdfs/logs', 'HDFS_FS': 'bind', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env (cluster.py:86, _create_env_file) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:26:07 [ 449 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:26:07 [ 449 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:26:07 [ 449 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:26:07 [ 449 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:26:07 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... pulling from prasanthj/docker-had... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... status: image is up to date for p... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:27:01 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:27:01 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling hdfs1 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling hdfs1 ... pulling from prasanthj/docker-had... Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... Pulling hdfs1 ... status: image is up to date for p... Pulling hdfs1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:27:01 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... pulling from prasanthj/docker-had... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... status: image is up to date for p... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:27:54 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:27:54 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling hdfs1 ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling hdfs1 ... pulling from prasanthj/docker-had... Pulling node ... pulling from altinityinfra/integr... Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... Pulling hdfs1 ... status: image is up to date for p... Pulling hdfs1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:27:57 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... pulling from prasanthj/docker-had... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... status: image is up to date for p... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:28:51 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:28:51 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling hdfs1 ... Pulling minio1 ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling hdfs1 ... pulling from prasanthj/docker-had... Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... Pulling hdfs1 ... status: image is up to date for p... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling hdfs1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:28:57 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... pulling from prasanthj/docker-had... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... status: image is up to date for p... (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:29:51 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:29:51 [ 449 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling hdfs1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling hdfs1 ... pulling from prasanthj/docker-had... Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... Pulling hdfs1 ... status: image is up to date for p... Pulling hdfs1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:30:00 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... pulling from prasanthj/docker-had... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... status: image is up to date for p... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling hdfs1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:30:53 [ 449 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling hdfs1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling hdfs1 ... pulling from prasanthj/docker-had... Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... Pulling hdfs1 ... status: image is up to date for p... Pulling hdfs1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:30:53 [ 449 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:30:53 [ 449 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:30:53 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : Docker networks for project roottestendpointmacrosubstitution are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:30:53 [ 449 ] DEBUG : Docker containers for project roottestendpointmacrosubstitution are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:30:53 [ 449 ] DEBUG : Docker volumes for project roottestendpointmacrosubstitution are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:30:53 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestendpointmacrosubstitution_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : No running containers for project: roottestendpointmacrosubstitution (cluster.py:829, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:30:53 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:30:53 [ 449 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:30:53 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:30:53 [ 449 ] DEBUG : Docker networks for project roottestendpointmacrosubstitution are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:30:54 [ 449 ] DEBUG : Docker containers for project roottestendpointmacrosubstitution are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:30:54 [ 449 ] DEBUG : Docker volumes for project roottestendpointmacrosubstitution are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:30:54 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestendpointmacrosubstitution_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:30:54 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:30:54 [ 449 ] DEBUG : No running containers for project: roottestendpointmacrosubstitution (cluster.py:829, cleanup) 2026-10-26 12:30:54 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:30:54 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:30:54 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:30:54 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:30:54 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:30:54 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:30:54 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:30:54 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ____________________ ERROR at setup of test_select_by_type _____________________ @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=["configs/storage.xml", "configs/macros.xml"], with_minio=True, with_hdfs=True, ) > cluster.start() test_endpoint_macro_substitution/test.py:27: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling hdfs1 ... E Pulling proxy1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... done E Pulling node ... pulling from altinityinfra/integr... E Pulling hdfs1 ... pulling from prasanthj/docker-had... E Pulling hdfs1 ... digest: sha256:f32fa57500698c8643... E Pulling hdfs1 ... status: image is up to date for p... E Pulling hdfs1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception =================================== FAILURES =================================== _______ test_secure_cluster_distributed_over_distributed_different_users _______ def test_secure_cluster_distributed_over_distributed_different_users(): # This works because we will have initial_user='default' > n1.query( "SELECT * FROM remote('n1', currentDatabase(), dist_secure)", user="new_user" ) test_distributed_inter_server_secret/test.py:416: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3456: in query return self.client.query( helpers/client.py:36: in wrap return func(self, *args, **kwargs) helpers/client.py:74: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 210, stderr: Received exception from server (version 24.3.18): E Code: 210. DB::Exception: Received from 172.16.1.6:9000. DB::NetException. DB::NetException: Connection reset by peer, while reading from socket (172.16.1.5:9000): while receiving packet from n2:9000: While executing Remote. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x000000003a554b73 E 1. ./build_docker/./src/Common/Exception.cpp:96: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001cb49070 E 2. ./contrib/llvm-project/libcxx/include/string:1499: DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type>, String&&, String&&) @ 0x000000001ceef276 E 3. ./build_docker/./src/IO/ReadBufferFromPocoSocket.cpp:86: DB::ReadBufferFromPocoSocket::nextImpl() @ 0x000000001ceed5d2 E 4. DB::ReadBuffer::next() @ 0x000000000b5218ab E 5. ./src/IO/ReadBuffer.h:0: void DB::varint_impl::readVarUInt(unsigned long&, DB::ReadBuffer&) @ 0x000000001cc72b2a E 6. ./src/IO/VarInt.h:0: DB::Connection::receivePacket() @ 0x000000003241519e E 7. ./build_docker/./src/Client/PacketReceiver.cpp:0: DB::PacketReceiver::Task::run(std::function, std::function) @ 0x00000000324c4cef E 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000002b415606 E 9. ./contrib/llvm-project/libcxx/include/__functional/function.h:818: ? @ 0x000000002b4149fd E 10. ./contrib/boost/boost/context/fiber_ucontext.hpp:82: void boost::context::detail::fiber_entry_func>>(unsigned int, unsigned int) @ 0x000000002b411e14 E . (NETWORK_ERROR) E (query: SELECT * FROM remote('n1', currentDatabase(), dist_secure)) helpers/client.py:239: QueryRuntimeException ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:20:19 [ 449 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:19 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:20:19 [ 449 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:20:19 [ 449 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:20:19 [ 449 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:20:19 [ 449 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:20:19 [ 449 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:20:19 [ 449 ] INFO : Running tests in /ClickHouse/tests/integration/test_distributed_inter_server_secret/test.py (cluster.py:2659, start) 2026-10-26 12:20:19 [ 449 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:20:19 [ 449 ] DEBUG : Docker networks for project roottestdistributedinterserversecret are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:19 [ 449 ] DEBUG : Docker containers for project roottestdistributedinterserversecret are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:20 [ 449 ] DEBUG : Docker volumes for project roottestdistributedinterserversecret are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:20 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:20:20 [ 449 ] DEBUG : Docker networks for project roottestdistributedinterserversecret are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:20 [ 449 ] DEBUG : Docker containers for project roottestdistributedinterserversecret are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:20 [ 449 ] DEBUG : Docker volumes for project roottestdistributedinterserversecret are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:20 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestdistributedinterserversecret_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:20:20 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:20:20 [ 449 ] DEBUG : No running containers for project: roottestdistributedinterserversecret (cluster.py:829, cleanup) 2026-10-26 12:20:20 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:20:20 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:20:20 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:20:20 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:20:20 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:20:20 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:20:20 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:20 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:20:20 [ 449 ] DEBUG : Setup directory for instance: n1 (cluster.py:2679, start) 2026-10-26 12:20:20 [ 449 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_distributed_inter_server_secret/configs/remote_servers_n1.xml', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/database (cluster.py:4488, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/logs (cluster.py:4499, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Setup directory for instance: n2 (cluster.py:2679, start) 2026-10-26 12:20:20 [ 449 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_distributed_inter_server_secret/configs/remote_servers_n2.xml', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/configs/remote_servers.xml'] to /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/database (cluster.py:4488, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/logs (cluster.py:4499, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:20:20 [ 449 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2993bc2bf171', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env (cluster.py:86, _create_env_file) 2026-10-26 12:20:20 [ 449 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:20:20 [ 449 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:20:20 [ 449 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:20:20 [ 449 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:20:20 [ 449 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:20:20 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', '--project-name', 'roottestdistributedinterserversecret', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n2 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling n1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:30 [ 449 ] DEBUG : Setup ZooKeeper (cluster.py:2721, start) 2026-10-26 12:20:30 [ 449 ] DEBUG : Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/log', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/config', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/log', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/config', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/coordination', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/log', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/config', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/coordination'] (cluster.py:2722, start) 2026-10-26 12:20:30 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', '--project-name', 'roottestdistributedinterserversecret', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--verbose', 'up', '-d'] (cluster.py:113, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.config.config.find: Using configuration files: /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.docker_client.get_client: docker-compose version 1.29.2, build unknown (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:docker-py version: (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:CPython version: 3.10.12 (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:OpenSSL version: OpenSSL 3.0.2 15 Mar 2022 (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker base_url: http+docker://localhost (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker version: Platform={'Name': 'Docker Engine - Community'}, Components=[{'Name': 'Engine', 'Version': '23.0.6', 'Details': {'ApiVersion': '1.42', 'Arch': 'amd64', 'BuildTime': '2023-05-05T21:18:13.000000000+00:00', 'Experimental': 'false', 'GitCommit': '9dbdbd4', 'GoVersion': 'go1.19.9', 'KernelVersion': '5.15.0-130-generic', 'MinAPIVersion': '1.12', 'Os': 'linux'}}, {'Name': 'containerd', 'Version': '1.7.18', 'Details': {'GitCommit': 'ae71819c4f5e67bb4d5ae76a6b735f29cc25774e'}}, {'Name': 'runc', 'Version': '1.7.18', 'Details': {'GitCommit': 'v1.1.13-0-g58aa920'}}, {'Name': 'docker-init', 'Version': '0.19.0', 'Details': {'GitCommit': 'de40ad0'}}], Version=23.0.6, ApiVersion=1.42, MinAPIVersion=1.12, GitCommit=9dbdbd4, GoVersion=go1.19.9, Os=linux, Arch=amd64, KernelVersion=5.15.0-130-generic, BuildTime=2023-05-05T21:18:13.000000000+00:00 (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestdistributedinterserversecret_default') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info <- () (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info -> {'Architecture': 'x86_64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'BridgeNfIp6tables': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'BridgeNfIptables': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'CPUSet': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'CPUShares': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'CgroupDriver': 'cgroupfs', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'CgroupVersion': '2', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'ContainerdCommit': {'Expected': 'ae71819c4f5e67bb4d5ae76a6b735f29cc25774e', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'ID': 'ae71819c4f5e67bb4d5ae76a6b735f29cc25774e'}, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Containers': 0, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestdistributedinterserversecret_default') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.network.ensure: Creating network "roottestdistributedinterserversecret_default" with the default driver (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network <- (name='roottestdistributedinterserversecret_default', driver=None, options=None, ipam=None, internal=False, enable_ipv6=False, labels={'com.docker.compose.project': 'roottestdistributedinterserversecret', 'com.docker.compose.network': 'default', 'com.docker.compose.version': '1.29.2'}, attachable=True, check_duplicate=True) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network -> {'Id': 'b0218f7181c33f758f77a07f204cf3bf63a6e180d92ccb6eaec62e314c08a402', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Warning': ''} (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {, , } (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_zoo3_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestdistributedinterserversecret', service='zoo3', number=1)} (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestdistributedinterserversecret', service='zoo3', number=1) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_zoo2_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestdistributedinterserversecret', service='zoo2', number=1)} (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestdistributedinterserversecret', service='zoo2', number=1) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestdistributedinterserversecret', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: fbaefbcf458fc533c371b706b69008bdd72aa64314ed276f674edb8a2b5a3ac3 (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestdistributedinterserversecret_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/coordination', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Target': '/var/lib/clickhouse-keeper', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config3.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:2993bc2bf171', user='0', volumes={}, name='roottestdistributedinterserversecret_zoo3_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestdistributedinterserversecret', 'com.docker.compose.service': 'zoo3', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'fbaefbcf458fc533c371b706b69008bdd72aa64314ed276f674edb8a2b5a3ac3'}, host_config={'NetworkMode': 'roottestdistributedinterserversecret_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestdistributedinterserversecret_default': {'Aliases': ['zoo3'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_zoo1_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestdistributedinterserversecret', service='zoo1', number=1)} (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestdistributedinterserversecret', service='zoo1', number=1) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:2993bc2bf171') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': 'f6ee28add88814f1df3b0cd2c78f45264cb2f87724378a62bbfdaae8b1962890', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('f6ee28add88814f1df3b0cd2c78f45264cb2f87724378a62bbfdaae8b1962890') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 70823d679a33f7cdb5bb4f2357ed4c03e1575a73218aba36bcdd94d50dd1b554 (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestdistributedinterserversecret_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Source': '/clickhouse', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Target': '/usr/bin/clickhouse', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config2.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:2993bc2bf171', user='0', volumes={}, name='roottestdistributedinterserversecret_zoo2_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestdistributedinterserversecret', 'com.docker.compose.service': 'zoo2', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '70823d679a33f7cdb5bb4f2357ed4c03e1575a73218aba36bcdd94d50dd1b554'}, host_config={'NetworkMode': 'roottestdistributedinterserversecret_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestdistributedinterserversecret_default': {'Aliases': ['zoo2'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 9ea4cb49724a8b1421c319f8bd26cd16d5e8bbe7a581bb9b2a0b984368335bb9 (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestdistributedinterserversecret_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/config', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Target': '/etc/clickhouse-keeper', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config1.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:2993bc2bf171', user='0', volumes={}, name='roottestdistributedinterserversecret_zoo1_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestdistributedinterserversecret', 'com.docker.compose.service': 'zoo1', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '9ea4cb49724a8b1421c319f8bd26cd16d5e8bbe7a581bb9b2a0b984368335bb9'}, host_config={'NetworkMode': 'roottestdistributedinterserversecret_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestdistributedinterserversecret_default': {'Aliases': ['zoo1'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config3.xml', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('f6ee28add88814f1df3b0cd2c78f45264cb2f87724378a62bbfdaae8b1962890', 'roottestdistributedinterserversecret_default') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('f6ee28add88814f1df3b0cd2c78f45264cb2f87724378a62bbfdaae8b1962890', 'roottestdistributedinterserversecret_default', aliases=['f6ee28add888', 'zoo3'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('f6ee28add88814f1df3b0cd2c78f45264cb2f87724378a62bbfdaae8b1962890') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': 'f4096b97ac9ce48f8f2735022f48426d8d2620ab4ce89f3672fd743b2c17f79a', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('f4096b97ac9ce48f8f2735022f48426d8d2620ab4ce89f3672fd743b2c17f79a') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config2.xml', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('f4096b97ac9ce48f8f2735022f48426d8d2620ab4ce89f3672fd743b2c17f79a', 'roottestdistributedinterserversecret_default') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('f4096b97ac9ce48f8f2735022f48426d8d2620ab4ce89f3672fd743b2c17f79a', 'roottestdistributedinterserversecret_default', aliases=['zoo2', 'f4096b97ac9c'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('f4096b97ac9ce48f8f2735022f48426d8d2620ab4ce89f3672fd743b2c17f79a') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '9fc3547b06beeefa4dc49c518297f38dbfe52423bfdef0a527b6e4113409d451', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('9fc3547b06beeefa4dc49c518297f38dbfe52423bfdef0a527b6e4113409d451') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config1.xml', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('9fc3547b06beeefa4dc49c518297f38dbfe52423bfdef0a527b6e4113409d451', 'roottestdistributedinterserversecret_default') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('9fc3547b06beeefa4dc49c518297f38dbfe52423bfdef0a527b6e4113409d451', 'roottestdistributedinterserversecret_default', aliases=['zoo1', '9fc3547b06be'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('9fc3547b06beeefa4dc49c518297f38dbfe52423bfdef0a527b6e4113409d451') (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestdistributedinterserversecret', service='zoo3', number=1) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_zoo3_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestdistributedinterserversecret', service='zoo2', number=1) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_zoo2_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestdistributedinterserversecret', service='zoo1', number=1) (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_zoo1_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2026-10-26 12:20:32 [ 449 ] DEBUG : Wait ZooKeeper to start (cluster.py:2377, wait_zookeeper_to_start) 2026-10-26 12:20:32 [ 449 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:2008, get_instance_ip) 2026-10-26 12:20:32 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestdistributedinterserversecret_zoo1_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:32 [ 449 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.1.4, port:2181, use_ssl:False (cluster.py:3142, get_kazoo_client) 2026-10-26 12:20:32 [ 449 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:32 [ 449 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-26 12:20:32 [ 449 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:32 [ 449 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-26 12:20:32 [ 449 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:32 [ 449 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-26 12:20:33 [ 449 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:33 [ 449 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-26 12:20:33 [ 449 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:33 [ 449 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-26 12:20:34 [ 449 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:34 [ 449 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-10-26 12:20:36 [ 449 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-10-26 12:20:36 [ 449 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-10-26 12:20:36 [ 449 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-10-26 12:20:36 [ 449 ] DEBUG : get_instance_ip instance_name=zoo2 (cluster.py:2008, get_instance_ip) 2026-10-26 12:20:36 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestdistributedinterserversecret_zoo2_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:36 [ 449 ] DEBUG : get_kazoo_client: zoo2, ip:172.16.1.3, port:2181, use_ssl:False (cluster.py:3142, get_kazoo_client) 2026-10-26 12:20:36 [ 449 ] INFO : Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-10-26 12:20:36 [ 449 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-10-26 12:20:36 [ 449 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-10-26 12:20:36 [ 449 ] DEBUG : get_instance_ip instance_name=zoo3 (cluster.py:2008, get_instance_ip) 2026-10-26 12:20:36 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestdistributedinterserversecret_zoo3_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:36 [ 449 ] DEBUG : get_kazoo_client: zoo3, ip:172.16.1.2, port:2181, use_ssl:False (cluster.py:3142, get_kazoo_client) 2026-10-26 12:20:36 [ 449 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2026-10-26 12:20:36 [ 449 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2026-10-26 12:20:36 [ 449 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-10-26 12:20:36 [ 449 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-10-26 12:20:36 [ 449 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-10-26 12:20:36 [ 449 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-10-26 12:20:36 [ 449 ] DEBUG : All instances of ZooKeeper Secure started (cluster.py:2392, wait_zookeeper_nodes_to_start) 2026-10-26 12:20:36 [ 449 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env --project-name roottestdistributedinterserversecret --file /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/docker-compose.yml up -d --no-recreate') (cluster.py:3002, start) 2026-10-26 12:20:36 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', '--project-name', 'roottestdistributedinterserversecret', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/docker-compose.yml', 'up', '-d', '--no-recreate'] (cluster.py:113, run_and_check) 2026-10-26 12:20:37 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_n1_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:37 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_n2_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:37 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_n1_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:37 [ 449 ] DEBUG : Stderr:Creating roottestdistributedinterserversecret_n2_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:37 [ 449 ] DEBUG : ClickHouse instance created (cluster.py:3010, start) 2026-10-26 12:20:37 [ 449 ] DEBUG : get_instance_ip instance_name=n1 (cluster.py:2008, get_instance_ip) 2026-10-26 12:20:37 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestdistributedinterserversecret_n1_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:37 [ 449 ] DEBUG : Waiting for ClickHouse start in n1, ip: 172.16.1.6... (cluster.py:3017, start) 2026-10-26 12:20:37 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestdistributedinterserversecret_n1_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:37 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:37 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:38 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/94e3cf32bb50074a30941f57fa121369d9dc59a9361846a7c1d53a4ae643bde1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : ClickHouse n1 started (cluster.py:3021, start) 2026-10-26 12:20:39 [ 449 ] DEBUG : get_instance_ip instance_name=n2 (cluster.py:2008, get_instance_ip) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestdistributedinterserversecret_n2_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : Waiting for ClickHouse start in n2, ip: 172.16.1.5... (cluster.py:3017, start) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestdistributedinterserversecret_n2_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : http://localhost:None "GET /v1.42/containers/2c5cd4eb616a0c594e0f74dbfaffce883c4de68ecf30ba587dfd62a2980aee76/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2026-10-26 12:20:39 [ 449 ] DEBUG : ClickHouse n2 started (cluster.py:3021, start) 2026-10-26 12:20:39 [ 449 ] DEBUG : Executing query DROP TABLE IF EXISTS data on n1 (cluster.py:3455, query) 2026-10-26 12:20:40 [ 449 ] DEBUG : Executing query DROP TABLE IF EXISTS data_from_buffer on n1 (cluster.py:3455, query) 2026-10-26 12:20:40 [ 449 ] DEBUG : Executing query DROP TABLE IF EXISTS dist on n1 (cluster.py:3455, query) 2026-10-26 12:20:40 [ 449 ] DEBUG : Executing query CREATE TABLE data (key Int) Engine=Memory() on n1 (cluster.py:3455, query) 2026-10-26 12:20:40 [ 449 ] DEBUG : Executing query CREATE TABLE data_from_buffer (key Int) Engine=Memory() on n1 (cluster.py:3455, query) 2026-10-26 12:20:40 [ 449 ] DEBUG : Executing query CREATE TABLE dist_insecure AS data Engine=Distributed(insecure, currentDatabase(), data, key) on n1 (cluster.py:3455, query) 2026-10-26 12:20:41 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure AS data Engine=Distributed(secure, currentDatabase(), data, key) on n1 (cluster.py:3455, query) 2026-10-26 12:20:41 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_backward AS data Engine=Distributed(secure_backward, currentDatabase(), data, key) on n1 (cluster.py:3455, query) 2026-10-26 12:20:41 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_from_buffer AS data_from_buffer Engine=Distributed(secure, currentDatabase(), data_from_buffer, key) on n1 (cluster.py:3455, query) 2026-10-26 12:20:41 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_disagree AS data Engine=Distributed(secure_disagree, currentDatabase(), data, key) on n1 (cluster.py:3455, query) 2026-10-26 12:20:41 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_buffer AS dist_secure_from_buffer Engine=Buffer(currentDatabase(), dist_secure_from_buffer, /* settings for manual flush only */ 1, /* num_layers */ 0, /* min_time, placeholder */ 0, /* max_time, placeholder */ 0, /* min_rows */ 0, /* max_rows */ 0, /* min_bytes */ 0 /* max_bytes */ ) on n1 (cluster.py:3455, query) 2026-10-26 12:20:42 [ 449 ] DEBUG : Executing query DROP TABLE IF EXISTS data on n2 (cluster.py:3455, query) 2026-10-26 12:20:42 [ 449 ] DEBUG : Executing query DROP TABLE IF EXISTS data_from_buffer on n2 (cluster.py:3455, query) 2026-10-26 12:20:42 [ 449 ] DEBUG : Executing query DROP TABLE IF EXISTS dist on n2 (cluster.py:3455, query) 2026-10-26 12:20:42 [ 449 ] DEBUG : Executing query CREATE TABLE data (key Int) Engine=Memory() on n2 (cluster.py:3455, query) 2026-10-26 12:20:42 [ 449 ] DEBUG : Executing query CREATE TABLE data_from_buffer (key Int) Engine=Memory() on n2 (cluster.py:3455, query) 2026-10-26 12:20:42 [ 449 ] DEBUG : Executing query CREATE TABLE dist_insecure AS data Engine=Distributed(insecure, currentDatabase(), data, key) on n2 (cluster.py:3455, query) 2026-10-26 12:20:43 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure AS data Engine=Distributed(secure, currentDatabase(), data, key) on n2 (cluster.py:3455, query) 2026-10-26 12:20:43 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_backward AS data Engine=Distributed(secure_backward, currentDatabase(), data, key) on n2 (cluster.py:3455, query) 2026-10-26 12:20:43 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_from_buffer AS data_from_buffer Engine=Distributed(secure, currentDatabase(), data_from_buffer, key) on n2 (cluster.py:3455, query) 2026-10-26 12:20:43 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_disagree AS data Engine=Distributed(secure_disagree, currentDatabase(), data, key) on n2 (cluster.py:3455, query) 2026-10-26 12:20:43 [ 449 ] DEBUG : Executing query CREATE TABLE dist_secure_buffer AS dist_secure_from_buffer Engine=Buffer(currentDatabase(), dist_secure_from_buffer, /* settings for manual flush only */ 1, /* num_layers */ 0, /* min_time, placeholder */ 0, /* max_time, placeholder */ 0, /* min_rows */ 0, /* max_rows */ 0, /* min_bytes */ 0 /* max_bytes */ ) on n2 (cluster.py:3455, query) ------------------------------ Captured log call ------------------------------- 2026-10-26 12:20:43 [ 449 ] DEBUG : Executing query SELECT * FROM remote('n1', currentDatabase(), dist_secure) on n1 (cluster.py:3455, query) ---------------------------- Captured log teardown ----------------------------- 2026-10-26 12:20:44 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', '--project-name', 'roottestdistributedinterserversecret', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/docker-compose.yml', 'stop', '--timeout', '20'] (cluster.py:113, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_n1_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_n2_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_zoo1_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_zoo2_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_zoo3_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_n1_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_n2_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_zoo1_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_zoo3_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Stopping roottestdistributedinterserversecret_zoo2_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/logs/stderr.log* || true'] (cluster.py:113, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/logs/stderr.log* || true'] (cluster.py:113, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/.env', '--project-name', 'roottestdistributedinterserversecret', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_distributed_inter_server_secret/_instances_2/n2/docker-compose.yml', 'down', '--volumes'] (cluster.py:113, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_n1_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_n2_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_zoo1_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_zoo2_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_zoo3_1 ... (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_zoo1_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_zoo2_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_zoo3_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_n1_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing roottestdistributedinterserversecret_n2_1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stderr:Removing network roottestdistributedinterserversecret_default (cluster.py:123, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:20:48 [ 449 ] DEBUG : Docker networks for project roottestdistributedinterserversecret are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:20:48 [ 449 ] DEBUG : Docker containers for project roottestdistributedinterserversecret are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:20:48 [ 449 ] DEBUG : Docker volumes for project roottestdistributedinterserversecret are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:20:48 [ 449 ] DEBUG : Command:docker container list --all --filter name='^/roottestdistributedinterserversecret_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:20:48 [ 449 ] DEBUG : No running containers for project: roottestdistributedinterserversecret (cluster.py:829, cleanup) 2026-10-26 12:20:48 [ 449 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:20:48 [ 449 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:20:48 [ 449 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:20:48 [ 449 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:20:48 [ 449 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:20:48 [ 449 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ============================== slowest durations =============================== 318.12s setup test_encrypted_disk_replication/test.py::test_replication 286.89s setup test_endpoint_macro_substitution/test.py::test_different_types 24.08s setup test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users 4.52s teardown test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users 0.37s call test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users 0.00s teardown test_endpoint_macro_substitution/test.py::test_different_types 0.00s teardown test_endpoint_macro_substitution/test.py::test_select_by_type 0.00s teardown test_encrypted_disk_replication/test.py::test_replication 0.00s teardown test_encrypted_disk_replication/test.py::test_zero_copy_replication 0.00s setup test_endpoint_macro_substitution/test.py::test_select_by_type 0.00s setup test_encrypted_disk_replication/test.py::test_zero_copy_replication =========================== short test summary info ============================ FAILED test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users ERROR test_encrypted_disk_replication/test.py::test_replication - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... ERROR test_encrypted_disk_replication/test.py::test_zero_copy_replication - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/.env', '--project-name', 'roottestencrypteddiskreplication', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_encrypted_disk_replication/_instances_2/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... ERROR test_endpoint_macro_substitution/test.py::test_different_types - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling hdfs1 ... ERROR test_endpoint_macro_substitution/test.py::test_select_by_type - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/.env', '--project-name', 'roottestendpointmacrosubstitution', '--file', '/ClickHouse/tests/integration/test_endpoint_macro_substitution/_instances_2/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_hdfs.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling hdfs1 ... =================== 1 failed, 4 errors in 634.55s (0:10:34) ==================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 437, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_ervycs --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=2 --color=no --durations=0 test_distributed_inter_server_secret/test.py::test_secure_cluster_distributed_over_distributed_different_users test_encrypted_disk_replication/test.py::test_replication test_encrypted_disk_replication/test.py::test_zero_copy_replication test_endpoint_macro_substitution/test.py::test_different_types test_endpoint_macro_substitution/test.py::test_select_by_type -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 ' returned non-zero exit status 1.